The Global Temperament Project: Parent-reported temperament in infants, toddlers, and children from 59 nations.

Data from 83,423 parent reports of temperament (surgency, negative affectivity, and regulatory capacity) in infants, toddlers, and children from 341 samples gathered in 59 countries were used to investigate the relations among culture, gender, and temperament. Between-nation differences in temperament were larger than those obtained in similar studies of adult personality, and most pronounced for negative affectivity. Nation-level patterns of negative affectivity were consistent across infancy, toddlerhood, and childhood, and patterns of regulatory capacity were consistent between infancy and toddlerhood. Nations that previously reported high extraversion, high conscientiousness, and low neuroticism in adults were found to demonstrate high surgency in infants and children, and countries reporting low adult openness and high adult neuroticism reported high temperamental negative affectivity. Negative affectivity was high in Southern Asia, Western Asia, and South America and low in Northern and Western Europe. Countries in which children were rated as high in negative affectivity had cultural orientations reflecting collectivism, high power distance, and short-term orientation. Surgency was high in Southeastern and Southern Asia and Southern Europe and low in Eastern Asian countries characterized by philosophies of long-term orientation. Low personal income was associated with high negative affectivity. Gender differences in temperament were largely consistent in direction with prior studies, revealing higher regulatory capacity in females than males and higher surgency in males than females, with these differences becoming more pronounced at later ages. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Psychometric reliability, validity, and generalizability of 3MSE scores among American Indian adults: the Strong Heart Study.

OBJECTIVE: Modified Mini-Mental State Examination (3MSE) is often used to screen for dementia, but little is known about psychometric validity in American Indians. METHODS: We recruited 818 American Indians aged 65-95 for 3MSE examinations in 2010-2013; 403 returned for a repeat examination in 2017-2019. Analyses included standard psychometrics inferences for interpretation, generalizability, and extrapolation: factor analysis; internal consistency-reliability; test-retest score stability; multiple indicator multiple cause structural equation models. RESULTS: This cohort was mean age 73, majority female, mean 12 years education, and majority bilingual. The 4-factor and 2nd-order models fit best, with subfactors for orientation and visuo-construction (OVC), language and executive functioning (LEF), psychomotor and working memory (PMWM), verbal and episodic memory (VEM). Factor structure was supported for both research and clinical interpretation, and factor loadings were moderate to high. Scores were generally consistent over mean 7 years. Younger participants performed better in overall scores, but not in individual factors. Males performed better on OVC and LEF, females better on PMWM. Those with more education performed better on LEF and worse on OVC; the converse was true for bilinguals. All differences were significant, but small. CONCLUSION: These findings support use of 3MSE for individual interpretation in clinic and research among American Indians, with moderate consistency, stability, reliability over time. Observed extrapolations across age, sex, education, and bilingual groups suggest some important contextual differences may exist.

Psychometric Properties of Controlled Oral Word Association (COWA) Test and Associations With Education and Bilingualism in American Indian Adults: The Strong Heart Study.

The Controlled Oral Word Association (COWA) test is used to assess phonemic fluency and executive function. Formal validation of test scores is important for accurate cognitive evaluation. However, there is a dearth of psychometric validation among American Indian adults. Given high burden of dementia risk and key contextual factors associated with cognitive assessments, this represents a critical oversight. In a large, longitudinal population-based cohort study of adult American Indians, we examined several validity inferences for COWA, including scoring, generalization, and extrapolation inferences, by investigation of factor structure, internal consistency, test-retest reliability, and differential test functioning. We found adequate unidimensional model fit, with high factor loadings. Internal consistency reliability and test-retest reliability were 0.88 and 0.77, respectively, for the full group. COWA scores were lowest among the oldest, lowest education, bilingual speakers; group effects for sex and bilingual status were small; age effect was medium; and education effect was largest. However, Wide Range Achievement Test (WRAT) score effect was stronger than education effect, suggesting better contextualization may be needed. These results support interpretation of total COWA score, including across sex, age, or language use strata.

Measuring Food Security among American Indian and Alaska Native Adults: Validity Evidence Supports the Use of the US Department of Agriculture Module.

BACKGROUND: Inequities in access, availability, and affordability of nutritious foods produced by settler colonialism contribute to high rates of food insecurity among American Indian and Alaska Native (AI/AN) households. Efforts to understand the influences of food security programming among AI/AN individuals in the United States are constrained by the absence of validity evidence for food security assessments for this population. OBJECTIVE: This study assessed whether AI/AN adult responses on the Food Security Survey Module provide an accurate assessment of food security prevalence, especially when compared with other racial and ethnic groups. DESIGN: A correlational design with the cross-sectional 2019 National Health Interview Survey was used to address the research objective. PARTICIPANTS AND SETTING: The 2019 National Health Interview Survey contains a sample (N = 30,052) representative of the resident civilian noninstitutionalized population. MAIN OUTCOME MEASURES: The primary outcome was food security, as characterized by the 10-item US Department of Agriculture Adult Food Security Survey Module. The module evaluates whether insufficient finances result in perceived food shortages and a reduction in the quantity and/or quality of food intake during the prior 30 days. STATISTICAL ANALYSES PERFORMED: Data were analyzed by racial and ethnic subsamples to assess scale dimensionality (confirmatory factor analysis), Item Response Theory item analysis, differential item functioning, and external validity (χ2 tests). RESULTS: Results supported the use of the 10-item module for racial and ethnic groups. However, differential item functioning effect sizes exceeded criteria for the Asian, AI/AN, and Hispanic respondents when compared with White respondents. Food security was not significantly related to all expected correlates in the AI/AN subsample. CONCLUSIONS: Compelling evidence is presented for validity of the FSSM scores in determining food security status of AI/AN adults. Qualitative inquiry that explores how culture influences the way food security is conceptualized and experienced is warranted.

Latent profile similarity of middle and high school youth risk and needs.

Research concerning school success and completion has grown increasingly complex with the number of proposed associated risk and needs domains. As the number of domains expands, various data analytical techniques have been employed to understand them, including the modeling of latent profiles, to better understand how risks and needs aggregate at the level of individual persons. Latent profile analysis helps identify individuals' subgroups based on salient combinations of characteristics. The present study used latent profile analysis and a systematic profile similarity approach to examine the profiles across middle and high school student cohorts. The study replicates the profiles of previous work with high school students and extends this to middle school students. We used two independent cohorts to replicate a 3-profile solution for middle and high school samples. Results supported a similar 3-profile solution for both samples, with minor discrepancies. Results are discussed with respect to the replication and extension of the 3-profile model and its application to efforts to improve outcomes for youth in both grade level cohorts.

A Comparison of Confirmatory Factor Analysis and Network Models for Measurement Invariance Assessment When Indicator Residuals are Correlated.

Social science research is heavily dependent on the use of standardized assessments of a variety of phenomena, such as mood, executive functioning, and cognitive ability. An important assumption when using these instruments is that they perform similarly for all members of the population. When this assumption is violated, the validity evidence of the scores is called into question. The standard approach for assessing the factorial invariance of the measures across subgroups within the population involves multiple groups confirmatory factor analysis (MGCFA). CFA models typically, but not always, assume that once the latent structure of the model is accounted for, the residual terms for the observed indicators are uncorrelated (local independence). Commonly, correlated residuals are introduced after a baseline model shows inadequate fit and inspection of modification indices ensues to remedy fit. An alternative procedure for fitting latent variable models that may be useful when local independence does not hold is based on network models. In particular, the residual network model (RNM) offers promise with respect to fitting latent variable models in the absence of local independence via an alternative search procedure. This simulation study compared the performances of MGCFA and RNM for measurement invariance assessment when local independence is violated, and residual covariances are themselves not invariant. Results revealed that RNM had better Type I error control and higher power compared to MGCFA when local independence was absent. Implications of the results for statistical practice are discussed.

Applicability and Efficiency of a Computerized Adaptive Test for the Washington Assessment of the Risks and Needs of Students.

The Washington Assessment of the Risks and Needs of Students (WARNS) is a computer-based assessment created to help courts, schools, and youth service providers determine an adolescent's risks and needs that may lead to truancy, drop out, or delinquency from school. Users are advised to consider the WARNS total score to work with youth. A total score estimate based on fewer items than the full item set may result in less respondent burden, administration time, and fatigue, while not hindering accurate decisions. This simulation study examined the applicability and efficiency of a computerized adaptive test (CAT) to estimate a WARNS total score under a unidimensional item response theory model. The results demonstrate that the CAT provides an accurate estimate of students' risks and needs and reduces the number of items administered for each examinee compared with the existing version. Future directions and limitations of CAT development with the WARNS are discussed.

Assessment of the Risks and Needs of Middle School Students: Invariance Properties Related to Gender and Ethnicity.

The middle school version of the Washington Assessment of Risks and Needs of Students (msWARNS) is a self-report instrument designed for use by school personnel to identify barriers to school attendance and school success for sixth- to eighth-grade students. It measures six domains relevant to improving school outcomes that include aggression-defiance, depression-anxiety, substance use, peer deviance, home environment, and school engagement. In the present study, a bifactor S - 1 model, for which the aggression-defiance domain was the reference factor for the general factor and the other domains constituted the subfactors, had good fit and better fit than several other alternative models. Results of multigroup confirmatory factor analysis revealed invariance across different groups defined by gender and race/ethnicity (Native American, African American, Hispanic, and White), with a sample of referred middle school students (N = 2,356; ages 10-15 years). Reliability analyses support the use of the general factor to guide decision-making, the reliable use of the depression-anxiety factor for providing additional insights, and the remaining factors for guiding communication, as part of an assessment and intervention program for middle school students.

Relations between bedtime parenting behaviors and temperament across 14 cultures.

Objectives: The present study examined parental sleep-supporting practices during toddlerhood in relation to temperament across 14 cultures. We hypothesized that passive sleep-supporting techniques (e.g., talking, cuddling), but not active techniques (e.g., walking, doing an activity together), would be associated with less challenging temperament profiles: higher Surgency (SUR) and Effortful Control (EC) and lower Negative Emotionality (NE), with fine-grained dimensions exhibiting relationships consistent with their overarching factors (e.g., parallel passive sleep-supporting approach effects for dimensions of NE). Methods: Caregivers (N = 841) across 14 cultures (M = 61 families per site) reported toddler (between 17 and 40 months of age; 52% male) temperament and sleep-supporting activities. Utilizing linear multilevel regression models and group-mean centering procedures, we assessed the role of between- and within-cultural variance in sleep-supporting practices in relation to temperament. Results: Both within-and between-culture differences in passive sleep-supporting techniques were associated with temperament attributes, (e.g., lower NE at the between-culture level; higher within-culture EC). For active techniques only within-culture effects were significant (e.g., demonstrating a positive association with NE). Adding sleep-supporting behaviors to the regression models accounted for significantly more between-culture temperament variance than child age and gender alone. Conclusion: Hypotheses were largely supported. Findings suggest parental sleep practices could be potential targets for interventions to mitigate risk posed by challenging temperament profiles (e.g., reducing active techniques that are associated with greater distress proneness and NE).

Contributions of causal reasoning to early scientific literacy.

Although early causal reasoning has been studied extensively, inconsistency in the tasks used to assess it has clouded our understanding of its structure, development, and relevance to broader developmental outcomes. The current research attempted to bring clarity to these questions by exploring patterns of performance across several commonly used measures of causal reasoning, and their relation to scientific literacy, in a sample of 3- to 5-year-old children from diverse backgrounds (N = 153). A longitudinal confirmatory factor analysis revealed that some measures of causal reasoning (counterfactual reasoning, causal learning, and causal inference), but not all of them (tracking cause-effect associations and resolving confounded evidence), assess a unidimensional factor and that this resulting factor was relatively stable across time. A cross-lagged panel model analysis revealed associations between causal reasoning and scientific literacy across each age tested. Causal reasoning and scientific literacy related to each other concurrently, and each predicted the other in subsequent years. These relations could not be accounted for by children's broader cognitive skills. Implications for early STEM (science, technology, engineering, and math) engagement and success are discussed.

A Motivational-Developmental Free Response Assessment Through a Bifactor Lens.

The Motivational-Developmental Assessment (MDA) measures a university student's motivational and developmental attributes by utilizing overlapping constructs measured across four writing prompts. The MDA's format may lead to the violation of the local item independence (LII) assumption for unidimensional item response theory (IRT) scoring models, or the uncorrelated errors assumption for scoring models in classical test theory (CTT) due to the measurement of overlapping constructs within a prompt. This assumption violation is known as a testlet effect, which can be viewed as a method effect. The application of a unidimensional IRT or CTT model to score the MDA can result in imprecise parameter estimates when this effect is ignored. To control for this effect in the MDA responses, we first examined the presence of local dependence via a restricted bifactor model and Yen's Q3 statistic. Second, we applied bifactor models to account for the testlet effect in the responses, as this effect is modeled as an additional latent variable in a factor model. Results support the presence of local dependence in two of the four MDA prompts, and the use of the restricted bifactor model to account for the testlet effect in the responses. Modeling the testlet effect through the restricted bifactor model supports a scoring inference in a validation argument framework. Implications are discussed.

Links between television exposure and toddler dysregulation: Does culture matter?

Television exposure in early childhood has increased, with concerns raised regarding adverse effects on social-emotional development, and emerging self-regulation in particular. The present study addressed television exposure (i.e., amount of time watching TV) and its associations with toddler behavioral/emotional dysregulation, examining potential differences across 14 cultures. The sample consisted of an average of 60 toddlers from each of the 14 countries from the Joint Effort Toddler Temperament Consortium (JETTC; Gartstein & Putnam, 2018). Analyses were conducted relying on the multi-level modeling framework (MLM), accounting for between- and within-culture variability, and examining the extent to which TV exposure contributions were universal vs. variable across sites. Effects of time watching TV were evaluated in relation to temperament reactivity and regulation, as well as measures of emotional reactivity, attention difficulties, and aggression. Results indicated that more time spent watching TV was associated with higher ratings on Negative Emotionality, emotional reactivity, aggression, and attention problems, as well as lower levels of soothability. However, links between TV exposure and both attention problems and soothability varied significantly between cultures. Taken together, results demonstrate that increased time spent watching television was generally associated with dysregulation, although effects were not consistently uniform, but rather varied as a function of culturally-dependent contextual factors.

Item response theory analysis of the Triarchic Psychopathy Measure.

This study investigated item and scale functioning in the triarchic psychopathy measure (TriPM) using an item response theory (IRT) analysis. TriPM data collected from 937 (410 men and 527 women) college students and community members were analyzed. A graded response model was utilized to analyze the items comprising the TriPM's three scales. Exploratory factor analyses (EFAs) supported the unidimensionality of the Disinhibition and Meanness scales, whereas Boldness was best represented by two domains. Each TriPM scale was found to include some items that had limited ability to differentiate between respondents possessing varying levels of the trait being measured. Across all scales, 34 items (61%) yielded evidence of significantly different responding between men and women possessing similar levels of the underlying trait, or differential item functioning (DIF). The scoring format (i.e., directly scored vs. reverse scored) also influenced item functioning, especially when the given scale included a large majority of one scoring type. Overall, the IRT and DIF results suggest that the TriPM effectively identifies disinhibition and meanness in individuals possessing high levels of those traits, and boldness at lower levels, but does not seem to identify these traits equally well in men and women. Possible revisions to the Boldness scale as well as ideas for addressing female and male DIF were provided. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Quantifying Item Invariance for the Selection of the Least Biased Assessment.

An important aspect of educational and psychological measurement and evaluation of individuals is the selection of scales with appropriate evidence of reliability and validity for inferences and uses of the scores for the population of interest. One aspect of validity is the degree to which a scale fairly assesses the construct(s) of interest for members of different subgroups within the population. Typically, this issue is addressed statistically through assessment of differential item functioning (DIF) of individual items, or differential bundle functioning (DBF) of sets of items. When selecting an assessment to use for a given application (e.g., measuring intelligence), or which form of an assessment to use in a given instance, researchers need to consider the extent to which the scales work with all members of the population. Little research has examined methods for comparing the amount or magnitude of DIF/DBF present in two assessments when deciding which assessment to use. The current simulation study examines 6 different statistics for this purpose. Results show that a method based on the random effects item response theory model may be optimal for instrument comparisons, particularly when the assessments being compared are not of the same length.

Item Response Theory Analysis of the Psychopathic Personality Inventory-Revised.

This study examined item and scale functioning in the Psychopathic Personality Inventory-Revised (PPI-R) using an item response theory analysis. PPI-R protocols from 1,052 college student participants (348 male, 704 female) were analyzed. Analyses were conducted on the 131 self-report items comprising the PPI-R's eight content scales, using a graded response model. Scales collected a majority of their information about respondents possessing higher than average levels of the traits being measured. Each scale contained at least some items that evidenced limited ability to differentiate between respondents with differing levels of the trait being measured. Moreover, 80 items (61.1%) yielded significantly different responses between men and women presumably possessing similar levels of the trait being measured. Item performance was also influenced by the scoring format (directly scored vs. reverse-scored) of the items. Overall, the results suggest that the PPI-R, despite identifying psychopathic personality traits in individuals possessing high levels of those traits, may not identify these traits equally well for men and women, and scores are likely influenced by the scoring format of the individual item and scale.

Factor Structure and Invariance of an Adolescent Risks and Needs Assessment.

The Washington Assessment of Risks and Needs of Students is a youth self-report screening instrument developed for use by high school and juvenile court personnel faced with the legal and practical challenges of high truancy and dropout rates. It purports to measure six facets of risks and needs of youth relevant to improving school outcomes. In this study, a bifactor model measuring a general factor and six specific factors was examined for fit and invariance across different groups defined by sex and race/ethnicity, with a sample of court-petitioned high school students (N = 937; ages 13-17 years). The results of multigroup confirmatory factor analysis revealed an essentially invariant bifactor structure across the groups. Further analysis of reliability support the use of the general factor to guide decision making for youth at risk for truancy and school failure, and scores deriving from the six specific factors as providing insight on specific areas of risk and need.

Understanding School Truancy: Risk-Need Latent Profiles of Adolescents.

Washington state requires school districts to file court petitions on students with excessive unexcused absences resulting in thousands of youth becoming involved in the court system. Once in the system, decisions are made about the level of risk each youth has for maladaptive behaviors. The Washington Assessment of the Risks and Needs of Students was created to assist youth service providers, courts, and schools to identify an adolescent's needs for social, emotional, or educational intervention. However, the profile-based decisions advocated for by test developers lack empirical justification. This study employed latent profile analysis to examine risk and needs profiles of adolescents based on the Washington Assessment of the Risks and Needs of Students assessment. Profiles were developed to aid understanding of behaviors associated with school truancy, and examined across outcome variables (e.g., suspensions, arrests) to evaluate evidence in support of predictive claims. Results suggest distinct profiles that differ on important outcomes.

Item and Structure Evaluation of the Genomic Nursing Concept Inventory.

BACKGROUND AND PURPOSE: Genomic nursing education requires a genomic literacy assessment supported by evidence of reliability and validity. This study applied psychometric analyses to provide support for the Genomic Nursing Concept Inventory (GNCI). METHODS: Over nine semesters, baccalaureate nursing students (N = 1,065) completed the GNCI on the first and last days of genomics instruction. Psychometric analyses assessed scale and item performance pre- and post-instruction. RESULTS: Exploratory factor analysis supported scale unidimensionality and identified items with low pattern coefficients. Analyses supported test-retest and internal consistency reliability and criterion validity. Scale difficulty decreased by 28% from pre- to post-instruction. Underperforming items were identified for further inventory refinement. CONCLUSIONS: Findings support use of the GNCI to measure learning needs pre-instruction and learning gains post-instruction. Data also inform planned inventory revision.

Comparison of Methods for Factor Invariance Testing of a 1-Factor Model With Small Samples and Skewed Latent Traits.

A primary underlying assumption for researchers using a psychological scale is that scores are comparable across individuals from different subgroups within the population. In the absence of invariance, the validity of these scores for inferences about individuals may be questionable. Factor invariance testing refers to the methodological approach to assessing whether specific factor model parameters are indeed equivalent across groups. Though much research has investigated the performance of several techniques for assessing invariance, very little work has examined how methods perform under small sample size, and non-normally distributed latent trait conditions. Therefore, the purpose of this simulation study was to compare invariance assessment Type I error and power rates between (a) the normal based maximum likelihood estimator, (b) a skewed-t distribution maximum likelihood estimator, (c) Bayesian estimation, and (d) the generalized structured component analysis model. The study focused on a 1-factor model. Results of the study demonstrated that the maximum likelihood estimator was robust to violations of normality of the latent trait, and that the Bayesian and generalized component models may be useful in particular situations. Implications of these findings for research and practice are discussed.

Methods for the Comparison of Differential Item Functioning across Assessments.

An important aspect of the educational and psychological evaluation of individuals is the selection of scales with appropriate evidence of reliability and validity for inferences and uses of the scores for the population of interest. One key aspect of validity is the degree to which a scale fairly assesses the construct(s) of interest for members of different subgroups within the population. Typically, this issue is addressed statistically through assessment of differential item functioning (DIF) of individual items, or differential test functioning (DTF) of sets of items within the same measure. When selecting an assessment to use for a given application (e.g., measuring intelligence), or which form of an assessment to use for a test administration, researchers need to consider the extent to which the scales work with all members of the population. Little research has examined methods for comparing the amount or magnitude of DIF/DTF present in two or more assessments when deciding which assessment to use. The current study made use of 7 different statistics for this purpose, in the context of intelligence testing. Results demonstrate that by using a variety of effect sizes, the researcher can gain insights into not only which scales may contain the least amount of DTF, but also how they differ with regard to the way in which the DTF manifests itself.